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Abstract  -  Information  Fusion  coordinates  large-volume 
data  processing  machines  to  address  user  needs.  Users 
expect  a  situational  picture  to  extend  their  ability  of 
sensing  events,  movements,  and  activities.  Typically,  data 
is  collected  and  processed  for  object  location  (e.g.  target 
identification)  and  movement  (e.g.  tracking);  however, 
high-level  reasoning  or  situational  understanding  depends 
on  the  spatial,  cultural,  and  political  effects.  In  this  paper, 
we  explore  opportunities  where  information  fusion  can  aid 
in  the  selection  and  processing  of  the  data  for  enhanced 
tacit  knowledge  understanding  by  (1)  display  fusion  for 
data  presentation  (e.g.  cultural  segmentation),  (2) 
interactive  fusion  to  allow  the  user  to  inject  a  priori 
knowledge  (e..g.  cultural  values),  and  (3)  associated 
metrics  of  predictive  capabilities  (e.g.  cultural  networks). 
In  a  simple  scenario  for  target  identification  with 
deception,  cultural  information  impacts  on  situational 
understanding  is  demonstrated  using  the  Technology- 
Emotion-Culture-Knowledge  (TECK)  attributes  of  the 
Observe-Orient-Decide-Act  (OODA)  model. 

Keywords:  Fusion,  Situational  Assessment,  Interface 
Design,  Knowledge  Representation,  User  Refinement 

1  Introduction 

Cultural  implications  for  information  fusion  (IF)  design 
includes:  (1)  machine-level  data  preprocessing  to  output 
estimation,  (2)  user-level  defined  sensor  queries  to  display 
metrics,  and  (3)  system-level  operational  design  to  afford 
diplomatic  coordination.  IF  designs  are  employed  and 
utilized  by  different  users  with  individual  differences  for  a 
variety  of  missions.  These  differences  require  that  IF 
designs  be  tailored,  flexible,  and  amenable  to  different 
cultural  needs  (e.g.  harbor  data  collections  of  supply 
distributions,  communication  network  patterns,  and 
linguistic  variable  analysis). 

Machine  data  collection  from  sensors,  user  queries,  and 
operational  systems  seek  to  gather  information  to  answer 
questions  about  tactical  situations  and  relationships. 
Driven  by  operational  needs,  user  desires,  and  target 


behaviors;  cultural  importance  is  paramount  for  future  IF 
designs.  For  instance,  a  user  would  adapt  the  data 
collection  plans  based  on  the  targets,  environment,  and 
sensors  available.  The  targets  of  interest  would  also  be 
culturally  different  (e.g.,  large  cars  would  be  found  in  open 
highways  versus  bikes  in  urban  cities). 

User  situational  understanding  would  be  affected  by  the 
machine-processed  information,  individual  differences  in 
determining  what  operational  developments  are  unfolding, 
and  the  known  and  unknown  observations.  An  example  is 
targets  of  interest,  but  also  the  a  priori  feature  information 
used  in  the  estimation  process. 

Finally,  organizational  cultural  details  of  social- 
political  relationships  affect  the  strategic  data  use,  display 
design  for  teams  of  operators,  and  the  estimation  results 
across  networks.  Strategic  networks  include  the 
organization  and  mission  assessment. 

Issues  surrounding  Situation  Understanding  (SU)  1  are 
confounded  by  culture: 

( 1 )  Addressing  the  user  in  system  management  /  control 

(2)  Assessing  information  quality  of  a  priori  statistics 

(3)  Evaluating  Fusion  systems  to  deliver  user  info  needs, 

(4)  Organizational  culture  adopting  large-scale  IF  designs 

(5) Designing  displays  to  support  a  user’s  mental  model 

The  key  for  SU  the  user’s  mental  model  which  is  the 
world  representation  through  aggregated  data  and  the 
user’s  social,  political,  and  military  perception.  This  paper 
explores  the  importance  of  culture  (i.e.  attitudes  and 
beliefs)  for  SU.  The  motivation  for  the  work  is  to  develop 
a  way  to  utilize  cultural  knowledge  in  IF  design  and 
analysis  (i.e.  Bayes’  rule)  that  would  aid  a  variety  of  users. 
Section  2  discusses  SA/User  research  and  Section  3  details 
User  refinement  and  instantiating  models.  Section  4 
develops  issues  of  cultural  importance  for  Section  5  of 
fusion  processing.  Section  6  presents  a  deception  example 
with  discussions  and  conclusions  in  Section  7  and  8. 


1  Understanding  includes  user/machine  situation  assessment  [1], 
situation  awareness  [21,22]  ,  and  situation  analysis  [43]. 
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2  Background 

The  role  of  the  user  has  shown  to  be  important  in  IF  design 
in  Level  5  “user  refinement”.  Since  users  are  part  of  the 
system,  they  need  to  play  an  active  role  in  planning 
collections,  controlling  sensors,  and  addressing  anomalies. 
Historically,  the  user  requires  information  to  make  timely, 
accurate,  and  robust  decisions  as  exemplified  by  Boyd’s 
Observe-Orient-Decide-Act  (OODA)  cycle.  [1,  2] 

The  user’s  impact  on  the  fusion  design  is  categorized  as 
high-level  data  fusion  [3]  as  contrasted  to  low-level 
tracking  and  identification  methods  [4,  5].  Addressing  the 
user  roles  for  SU  encompasses  expert  system  rule 
extraction  [6],  decision-making  constructs  [7],  and 
decision  support  [8] .  The  user  must  also  address  situational 
and  threat  analysis  and  prediction  through  support  from 
such  things  as  an  “impact  matrix”  [9],  cross-impact  and 
synchronization  matrices  [10],  conflicting  data  [11],  and 
sensor  allocation  [12]. 

The  user’s  roles  have  been  employed  in  traditional  areas 
of  air-to-ground  target  tracking  [13]  and  maritime 
awareness  [3],  object  data  aggregation  for  SA  [14],  as  well 
as  emerging  areas  of  hard-soft  fusion  such  as  cyber  [15, 
16]  and  linguistic  analysis  [17]. 

2.1  Situation  Understanding  Models 

SU  is  an  important  concept  of  how  people  become  aware 
of  and  prioritize  things  happening  in  their  environment 
(i.e.  estimation  and  prediction  of  relations  among  entities). 
Designing  complex  and  often-distributed  decision  support 
systems  requires  an  understanding  of  both  the  fusion 
processes  and  the  decision-making  (DM)  processes. 
Important  aspects  of  fusion  include  timeliness,  mitigation 
of  uncertainty,  and  output  quality. 

The  recognition  primed  decision  making  model  [18] 
develops  the  user  DM  capability  based  on  the  current 
situation  and  past  experience.  The  Fusion  Situation 
Awareness  Model  [19]  highlights  user  information  needs 
for  SA.  Other  SA  models  are  available  [1,  20,  21,  22] 

SA  has  many  meanings  that  could  be  conveyed  from  the 
user’s  perceptual  needs  as  per  spatial  awareness, 
neurophysiological  [23],  perceptual  [24],  psychological 
[25],  and  cognitive  aspects  [26].  If  the  display/delivery  of 
information  is  not  consistent  with  the  user  expectations  or 
unexpected  situations  occur  which  a  machine  cannot 
handle,  implications  call  for  (1)  incorporating  the  user  in 
the  design  process,  (2)  gathering  user  needs,  and  (3) 
providing  the  user  with  available  control  actions. 

Ontological  [27]  and  linguistic  [28]  issues  such  as 
semantics,  efficacy,  and  spatio-temporal  queries  are 
important  in  developing  a  framework  for  user  refinement 
(or  interface  actions)  that  allow  the  system  to  coordinate 
with  the  user.  Such  an  example  is  a  query  system  in  which 
the  user  seeks  answers  to  questions.  The  reason  why  the 
users  will  do  better  than  a  machine  is  that  they  are  (1)  able 
to  reason  about  culture,  (2)  assess  what  are  the  likely 


behaviors,  and  (3)  bring  in  contextual  information  to 
reason  over  the  uncertainty.  [29] 

2.2  Cultural  Assessment 

One  emerging  area  of  cultural  analysis  is  counterdeception 
[30].  Cultural  analysis  can  be  both  of  the  user  and  the 
objects  being  monitored  such  as  harbor  security  [31]. 
User’s  typically  utilize  experience  of  the  sensors,  targets, 
and  environments  to  make  decisions;  however,  recent 
applications  include  intelligent  actors  [32]. 

3  User  Refinement 

User  refinement  is  typically  addressed  in  decision-making 
through  the  OODA  loop  [2].  The  OODA  loop  can  be  a 
machine,  individual,  or  organization  as  well  as  nested 
OODA  loops  within  actors  or  between  actors. 

3.1  Decision  Making  Cycle 

Intelligent  DM  employs  many  knowledge-based 
information  fusion  (KBIF)  strategies  such  as  neural 
networks,  fuzzy  logic,  Bayesian  networks,  evolutionary 
computing,  and  expert  systems.  [33]  Each  KBIF  strategy 
has  different  processing  durations.  Furthermore,  each 
strategy  differs  in  the  extent  to  which  it  is  constrained  by 
the  facility  with  which  the  user-fusion  system  may  employ 
it.  OODA  loops  help  model  a  DM  user’s  planned, 
estimated,  or  predicted  actions.  Assessing  susceptibilities 
and  vulnerabilities  to  detected/  estimated/  predicted  threat 
actions,  in  the  context  of  planned  actions,  cultural 
implications,  requires  a  concurrent  timeliness  assessment. 

3.2  User  Roles:  Reactive,  Proactive,  Preventive 

When  tasked  with  an  SA  analysis,  a  user  can  respond  in 
one  of  three  manners: 

•  In  a  Reactive  mode,  the  user  makes  a  rapid  detection  and 

minimizes  damage  or  repeat  offense.  An  IF  system  would 
gather  information  from  a  sensor  grid  detection  of  in-situ 
threats  and  is  ready  to  act.  In  this  model,  the  system 
interprets  and  alerts  users  to  immediate  threats. 

•  Proactive  mode,  the  user  utilizes  sensor  data  to  anticipate, 

detect,  and  capture  cultural  information  prior  to  an  event. 
For  anticipated  threats,  the  user  would  want  the  predicted 
locations  of  the  adversary  and  the  range  of  possible  actions. 

•  Preventive  Mode',  captures  the  entire  force  over  a  period  of 

time.  For  the  potential  threats,  the  user  could  utilize 
behavior  analysis  displays  that  piece  together  aggregated 
information  of  group  affiliations,  equipment  stores,  and 
previous  events  to  predict  actions  over  time. 

Level  5  is  intended  to  address  the  cognitive  SU  which 
includes  knowledge  representation  and  reasoning  methods. 
The  user  defines  a  fusion  system,  for  without  a  user,  there 
is  no  need  to  provide  fusion  of  multi-sensory  data.  The 
user  has  a  defined  role  with  objectives  and  missions. 

Level  Role 

0  Determines  what  and  how  much  data  value  to  collect 


1273 


1  Determines  the  target  priority  and  where  to  look 

2  Understands  scenario  context  and  user  role 

3  Defines  what  is  a  threat  and  adversarial  intent 

4  Determines  which  sensors  to  deploy  and  activate 

Assesses  the  utility  of  information 

5  Designs  user  interface  controls. 

A  user  is  forced  to  address  situational  cultural 
constraints.  We  define  user  refinement  (UR)  operations  as 
a  function  of  responsibilities.  Once  an  IF  design  is  ready, 
the  user  can  act  in  a  variety  ways:  monitoring  a  situation  in 
an  active  or  passive  role  or  planning  by  either  reacting  to 
new  data  or  proactive  control  over  future  course  of  actions. 
When  a  user  interacts  with  an  IF  system,  it  is  important  to 
support  knowledge  reasoning. 

Discovery  [34],  through  culture  assessment,  is  performed 
by  inductive  or  abductive  reasoning,  where  reasoned 
conclusions  are  stronger  than  the  premises  (evidence),  and 
the  hypothetical  inferences  produce  knowledge.  Induction 
is  developed  by  observing  a  limited  set  of  observations  or 
events  and  establishing  a  more  general/abstract  belief 
about  larger  and  future  populations  of  instances.  Abduction 
is  the  informal  or  pragmatic  mode  of  reasoning  to  describe 
how  we  “reason  to  the  best  explanation”.  Evaluating 
multiple  hypotheses  for  a  given  set  of  data,  one  can  arrive 
at  a  solution  or  explanation.  Exploratory  abduction 
incorporates  both  inductive  (hypothesis-creating)  and 
deductive  (hypothesis-testing)  operations  to  seek 
alternative  frames  of  discernment  for  a  given  set  of 
observations  such  as  deception  assessment. 

Applications  for  multisensor  IF  require  insightful 
analysis  of  how  these  systems  will  be  deployed  and 
utilized.  Increasingly  complex,  dynamically  changing 
scenarios  arise,  requiring  more  intelligent  and  efficient 
reasoning  strategies.  Integral  to  information  reasoning  is 
cultural  information  which  requires  pragmatic  knowledge 
representation  for  user  interactional] 

3.3  DFIG  Model 

A  useful  model  is  one  which  represents  a  real  world  system 
instantiation.  The  IF  community  has  rallied  behind  the 
Data  Fusion  Information  Group  (DFIG)  process  model 
(that  replaces  the  JDL  model)  with  its  revisions  and 
developments,  shown  in  Figure  2  [35].  Management 
functions  are  divided  into  sensor  control,  platform 
placement,  and  user  selection  to  meet  mission  objectives. 
Level  2  (SA)  includes  tacit  functions  which  are  inferred 
from  level  1  explicit  representations  of  object  assessment. 
Since  the  unobserved  aspects  of  the  SA  cannot  be 
processed  by  a  computer,  user  knowledge  and  reasoning  is 
necessary. 

Current  definitions,  [36],  include: 

Level  0  —  Data  Assessment:  estimation  and  prediction  of  signal/object 
observable  states  on  the  basis  of  pixel/signal  level  data  association 
(e.g.  information  systems  collections); 

Level  1  —  Object  Assessment:  estimation  and  prediction  of  entity  states 
on  the  basis  of  data  association,  continuous  state  estimation  and 
discrete  state  estimation  (e.g.  data  processing); 


Level  2  —  Situation  Assessment:  estimation  and  prediction  of  relations 
among  entities,  to  include  force  structure  and  force  relations, 
communications,  etc.  (e.g.  information  processing); 

Level  3  —  Impact  Assessment:  estimation  and  prediction  of  effects  on 
situations  of  planned  or  estimated  actions  by  the  participants;  to 
include  interactions  between  action  plans  of  multiple  players  (e.g. 
assessing  threat  actions  to  planned  actions  and  mission  requirements, 
performance  evaluation); 

Level  4  —  Process  Refinement  (an  element  of  Resource  Management): 
adaptive  data  acquisition  and  processing  to  support  sensing  objectives 
(e.g.  sensor  management  and  information  systems  dissemination, 
command/control). 

Level  5  —  User  Refinement  (an  element  of  Knowledge  Management): 
adaptive  determination  of  who  queries  information  and  who  has 
access  to  information  (e.g.  information  operations)  and  adaptive  data 
retrieved  and  displayed  to  support  cognitive  decision  making  and 
actions  (e.g.  human  computer  interface). 

Level  6  -  Mission  Management  (an  element  of  Platform  Management): 
adaptive  determination  of  spatial-temporal  control  of  assets  (e.g. 
airspace  operations)  and  route  planning  and  goal  determination  to 
support  team  decision  making  and  actions  (e.g.  theater  operations) 
over  social,  economic,  and  political  constraints. 


Figure  1.  DFIG  User-Fusion  model  [37]. 


3.4  OODA-TECK  Models 

In  Figure  1,  Bradford  and  Fitzhugh  developed  a 
Technology,  Emotion,  Culture,  and  Knowledge  (TECK) 
model  [37]  within  the  OODA  loop.  Specifically  the  role  of 
culture  is  developed  between  the  decide  and  act  phases. 
However,  one  can  think  of  culture  as  embedded  in  the 
entire  cycle,  yet  being  represented  or  instantiated  in  the  D- 
A  process  as  the  a  prior  cultural  states  are  in  the  A-OB 
process,  the  user’s  culture  in  the  0-0  process  and  extended 
operational  knowledge  in  the  0-D  process. 

The  OODA-TECK  model  incorporates  many  ideas  that 
can  be  instantiated  in  information  fusion  models  (i.e.  the 
DFIG  model).  The  OODA  phases  are:  [38] 

•  Decide :  User  engages  situational  knowledge  derived  from 

orientation.  The  decision  consists  of  evaluating  the 
situational  knowledge,  projecting  process  ramifications, 
focusing  on  a  chosen  set  of  plans,  and  prioritizing  the  plans. 
The  priority  of  the  plans  is  developed  through  cultural 
implications,  beliefs  in  the  desired  outcomes,  and  affects 
associated  with  the  plans  on  society. 

•  Act :  The  user/organization  engages  in  a  process  plan  that 

utilizes  environmental  conditions.  Transforming  the  abstract 
plan  into  instrumental  behavior  forces  changes  on  the 
society  for  the  environment.  The  change  would  be 
monitored  by  users  with  tasking  sensors  to  collect 
information  to  asses  tactical,  operational,  and  strategic 
developments  for  social-political  purposes. 
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•  Observe:  A  user/organization  interacts  with  the  environment, 

typically  by  controlling  sensors,  querying  information 
needs,  and  assimilating  observations  from  a  display.  The 
subject  transforms  data  into  a  situational  awareness  through 
reasoning  biased  by  their  beliefs,  emotions,  and  cultural 
perspectives. 

•  Orient :  A  user  or  organization  distills  information  from  data 

to  determine  situational  understanding  through  assessment 
of  the  environment  to  determine  a  coherent  state  of  affairs. 
The  information  is  integrated  with  knowledge  to  determine 
completeness,  accuracy,  and  timeliness  of  a  situation.  From 
here,  the  cycle  repeats  itself. 


Figure  1.  ODDA-TECK  model. 


anthropology,  and  sociology  that  affects  the  individual, 
organization,  or  machine  processing.  For  purposes  of  this 
paper,  we  are  interested  in  the  definition  of  culture  from 
both  implementation  and  observation. 


Infrastructure,  Economics 

Figure  2.  Human-Social  Science  Studies. 


From  Figure  1,  the  role  of  culture  is  highlighted  between 
the  D-A  phase;  however,  perception  clearly  allows  for 
interpretation  and  sensory  inputs  for  analysis  to  feed 
cultural  information  through  to  (1)  technology  by  way  of 
Fevel  1  “object  refinement”  and  Fevel  2  “situational 
assessment”  (SA)  information  estimation,  (2)  emotion 
through  Fevel  5  “user  refinement”  and  (3)  Fevel  4 
“process  refinement”  of  knowledge  weighting  and  course 
of  action  (COA)  planning. 

Organizations  include  individuals  and  teams  which 
requires  managing  people,  processes,  and  products. 
Industrial  business  management  includes  psychological, 
organizational,  social,  and  economic  effects  on  the  fusion 
design  (shown  in  Figure  3).  Fikewise  IF  is  managing 
people,  sensors,  and  cultural  data.  The  ability  to  develop 
SA  of  the  PMESII  (political,  military,  economic,  social, 
information,  and  infrastructure)  environment  would  entail 
user  reasoning  about  the  data  to  infer  information.  The 
current  priority  control  functions  include:  user,  mission, 
and  sensor  management.  For  example,  if  sensors  are 
deployed,  then  the  highest  ranking  official  coordinating  a 
mission  determines  who  gets  control  of  the  assets  (which  is 
not  under  automatic  control).  Once  cultural  treaties,  air 
space,  insurance  policies,  and  other  documentation  is  in 
place,  the  automatic  controller  (e.g.  sensor),  can  be  turned 
on. 

4  Cultural  Understanding 

Cultural  understanding  developments  of  IF  designs  can  be 
aided  by  other  research  fields  such  as  psychology, 


Culture  is  a  feature  of  terrain  that  has  been  constructed 
by  man  [39]  including  roads,  building,  and  canals, 
boundary  lines  as  well  internal  thoughts  and  processes  of 
man..  The  more  complete  definitions  of  culture  are  usually 
found  in  nonmilitary  writings.  Merriam-Webster’s  Online 
Dictionary  defines  culture  as: 

a.  the  integrated  pattern  of  human  knowledge,  belief,  and 

behavior  that  depends  upon  man's  capacity  for 
learning  /  transmitting  knowledge  to  generations 

b.  the  customary  beliefs,  social  forms,  and  material  traits  of 

a  racial,  religious,  or  social  group 

c.  the  set  of  shared  attitudes,  values,  goals,  and  practices 

that  characterizes  a  company  or  corporation. 

d.  the  set  of  values,  conventions,  or  social  practices 

associated  with  a  particular  field,  activity,  or  societal 
characteristic 

Culture  refers  to  social  capital  of  the  values,  beliefs, 
attitudes,  goals,  habits,  and  preferred  ways  of  behavior  of  a 
social  group  [38].  Culture  primarily  involves  values, 
attitudes,  beliefs,  assumptions,  preconceptions,  goals, 
assumptions,  and  expectations  which  are  displayed  in  some 
form  of  religion,  behavior,  and  customs. 

•  Values  are  the  social  principles  or  standards  held  or  accepted  by  an 

individual,  class  or  society. 

•  Attitudes  are  the  dispositions,  opinions,  or  mental  sets  held  by 

individuals  or  groups  of  people. 

•  Belief  is  the  mental  acceptance  of  something  as  true  especially  a 

doctrine,  creed,  or  tenet. 

•  Goals  are  objects  or  ends  that  a  person  or  group  strives  to  obtain — 

an  aim  or  aspiration. 

These  four  cultural  factors — values,  attitudes,  beliefs,  and 
goals — are  prevalent  and  common  in  most  civilizations 
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and  cultures  which  determine  what  data  collection  is 
performed,  by  whom,  and  what  analysis  is  done. 

4.1  IF-Cultural  Example 

The  use  of  cultural  information  for  an  IF  system  can 
directly  affect  data  collection  and  output  estimation.  An 
example  is  information  warfare  (IW)  [40]  but  could  easily 
be  seen  in  any  game-theoretic  or  multi-actor  decision 
system. 

Information  Warfare  consists  of  six  phases:  [41] 

•  Psychological  operations :  Use  of  information  to  affect  the 

opponent’s  reasoning 

•  Military  Deception :  Mislead  opponent  about  capabilities  and 

intentions 

•  Electronic  Warfare :  Deny  accurate  information  to  the 

opponent 

•  Physical  Destruction :  Affect  information  system  elements 

through  conversion  of  stored  energy  to  destructive  power. 

•  Security  measures :  Seek  to  keep  opponent  from  learning 

about  capabilities  and  intentions. 

•  Information  attach  Directly  corrupt  information  without 

visibly  changing  the  physical  entity  on  which  it  resides. 

Of  the  six  phases,  there  are  three  categories  (1)  actors,  (2) 
sensors,  and  (3)  information. 

•  Actors:  Psychological  Operations  (PSYOP)  [42]  involve 

actions  taken  to  change  the  perceptions  and  behavior  of 
individuals.  PSYOP  requires  an  accurate  understanding  of 
the  targeted  audience,  means  of  influence  in  terms  of  specific 
goals  and  objectives,  and  access  to  cultural,  sociopolitical, 
and  current-event/situation  data.  Information  needs  to  be 
accurate,  updated  as  close  to  real-time  as  possible,  and 
culturally  validated. 

•  Sensors'.  Implications  for  sensors  systems  results  in  cultural 

factors  in  collecting  and  disseminating  the  data.  For  example, 
if  an  organizational  culture  relies  heavily  on  a  certain  sensor 
for  data  collection,  then  it  becomes  a  point  of  operation.  For 
example,  GPS  is  used  in  a  wide  variety  of  sensors  for 
registration  accuracy.  Affecting  the  registration  of  sensors 
would  indeed  affect  IF  by  way  of  sensor  alignment,  data 
estimations,  and  sensor  control. 

•  Information :  attacks  would  also  be  cultural  dependent  on 

deception,  denial,  and  destruction  of  systems  that  display, 
disseminate,  and  deploy  information.  An  example  is  the 
cultural  use  of  wireless  systems. 

As  shown  through  the  example  of  IW,  cultural 
understanding  can  be  used  as  a  way  to  improve  the  focus 
of  attention  as  well  as  be  node  for  attack.  The  key  is  in  the 
user  perceptions  which  can  be  addressed  from  studies  of 
psychology  and  sociology. 

5  DM  Fusion  through  TECK 

The  users  have  many  roles  that  they  can  play  in  gathering, 
controlling,  filtering  and  assessing  data.  They  can  be 
passive  in  monitoring  the  display  or  active  in  altering  the 
display  information  (i.e.  change  weights).  The  user  can 
interpret  the  data  based  on  context  and  be  proactive  to 
collect  date  to  confirm  hypothesis  or  rule  out  anomalies. 


Additionally,  it  would  be  good  to  mathematically  model 
emotion  as  a  parameter,  that  could  be  sensed  from  bio¬ 
feedback,  but  it  would  be  hard  to  measure  its  validity. 

Bayes’  rule  offers  a  way  to  interpret  information  in  a 
sequential  way  by  accumulating  evidence  P(Y\X) 
(likelihood)  of  events  relating  to  the  outcome 

P(Y\X)  P(X)  =  P{X\Y)  P(T)  (1) 

where  P(X)  is  the  diagnosis  (cause),  Pi  Y)  the  effect 
(symptoms),  and  P{X\Y)  is  the  prediction  back  in  time. 


Using  Bayes’  Rule: 


P{X\Y)  = 


_ PjY  I X)  PjX) _ 

P{Y  I X)  P(X)  +  P(Y  I  -A)  PHY) 


Many  contextual  factors  can  lead  to  an  understanding  of 
cultural  issues  through  a  cause  and  effect  relation.  The  key 
is  to  expedite  decision  making  through  the  use  of 
contextual/cultural  information  and  or  enhanced  cultural 
understanding.  For  instance,  we  can  look  at  the  cultural 
effects  within  the  OODA  loop  as  it  affects  knowledge  for 
decision  making.  The  Bayesian  instantiation  would  occur 
at  each  phase  by  utilizing  the  calculations/  processing 
within  each  loop.  For  instance: 

D-A:  Platform  routing  and  system  management 
A-OB:  Sensor  exploitation  algorithms  to  determine  the 
probability  of  detection 

OB-OR:  Users  emotion,  bias,  and  weighting  of  evidence 
OR-D:  Incorporation  of  context  and  terrain  information  in 


targeting 


Figure  3.  Actor-Subject  Relations  in  PSYOPS. 


If  we  let  technology,  T,  be  the  IF  system,  then  the 
probability  of  technology  understanding  is  affected  by  the 
user’s  emotions  and  cultural  bias  P(T  I  E,  C)  which  can  be 
determined  from 


P(T  I E ,  C) 


P(C  I  T ,  E)  P(E  I  D  P(T) 
P(C  I  E)  P{E) 


(2) 


which  is  a  function  of  the  a  prior  capability  of  the  fusion 
system  to  provide  answers  P(T),  the  user’s  use  of  the 
technology  P(E  I  7),  and  cultural  issues  surrounding  the 
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organization’s  operational  use  of  the  technology  and 
individual  emotions  P(C  I  T,  E).  Furthermore,  the  result  is 
normalized  by  the  user’s  emotional  attitude  P(E)  and  their 
role  within  the  cultural  organization  P(C\E).  Note  that  the 
a  priori  assessment  of  the  users  could  be  their  tendencies 
to  conservative  or  risk-taking/aggressive  behavior.  Users 
could  view  the  technology  results  as  pessimistic  or 
optimistic  about  the  display. 

The  important  development  of  cultural  implications 
resides  in  decision  making  (as  planning  for  action  would 
require  plan  assessment  over  the  implications  of  actions). 
To  determine  the  knowledge  gained  (for  effective 
decision-making)  we  need  to  look  for  P(K  I  T,  E,  C )  which 
is  the  knowledge  of  the  IF  system  over  the  machine  (7), 
user  (E),  and  organization  (C).  All  are  included  in  the 
assessment  of  feasible  alternatives. 

Since  we  are  interested  in  how  culture  affects  system 
performance,  two  possible  ways  to  address  system  analysis 
include  (a)  culture  affects  (or  influences)  knowledge 
decisions  based  a  user’s  emotions  P(C  I  E)  and  (b)  the 
cultural  effect  (or  casual  result)  of  the  organization  given 
the  people  and  equipment  P(C  I  T,  E).  To  determine  the 
cultural  influences  for  the  system,  we  could  use  a 
likelihood  ratio  test  to  determine  affects  and  effects  of 
cultural  changes. 

For  cultural  affects  on  an  IF  system,  we  can  solve  for 
different  user’s  influence  on  the  process  (whether  they 
interact  well  with  the  IF  technology  solution)  : 


P(K  \T,E,Q 


7(717 ,  C)  7(C  I  E)  P(E) 
P{TECK) 


(3) 


7(C  I  E) 


P(TECK)  P(K  I  T,  7,  C) 
7(7  I  E,  Q  7(7) 


(4) 


The  discussion  is  confounded  with  the  system  and  would 
require  testing  in  a  work  domain  setting.  However,  using  a 
cognitive  work  assessment  (CWA)[43],  evaluation  could 
be  completed  for  the  user  and  the  technology: 


7(7  \  E,  C)  = 


P(C  I  T,  E)  P(E  I  7)  P(T) 
P{C  I  E)  P(E) 


(5) 


where  the  user's  role  in  the  organization  P(C  I  E)  and 
emotions  P(E)  could  be  determined  from  the  work 
environment.  The  IF  capability  would  also  be  fixed  for  a 
given  scenario. 

For  cultural  effects  of  a  IF  system  we  can  just  invert  the 
analysis  and  assess  a  different  likelihood  value. 


P(K  I  7,  7,  C) 


7(C  I  T ,  E)  P(E  I  T)  P(T) 
P(TECK) 


(6) 


7(C  I  T,  E) 


P(K  I  7,  7,  Cj  P (TECK) 
P(E  I  T)  P(T) 


(7) 


The  distinction  between  culture  influences  (affects)  and 
results  (effects)  can  be  understood  from  a  scenario. 


6  Cultural  Example 

The  cultural  example  involves  an  actor  (user)  who  wishes 
to  accumulate  evidence  on  the  behavior  of  a  subject 
(object).  The  standard  approach  might  be  to  conduct  object 
assessment  through  sensor  exploitation  using  belief  filters, 
finite-set  statistics,  or  DSmT  methods  for  tracking  and 
identifying  the  person.  However,  tracking  objects  with 
intelligent  users  requires  careful  assessment  of  cultural 
knowledge.  A  subject  contains  behaviors  and  reasoning  to 
explicitly  minimize  their  signature  through  appearance 
changes  (camouflage),  detection  avoidance  (concealment), 
and  induce  deception  techniques.  The  last  is  the  concern  as 
deception  techniques  come  from  cultural  influences  and 
knowledge  about  tactics,  behaviors,  and  procedures  that 
the  subject  uses  to  deceive. 

Culture  also  includes  the  user’s  bias.  The  user  utilizes 
machines  to  aggregate  information  for  decision-making. 
However,  the  machine  is  trained  to  detection  and  ID 
known  things,  not  the  unknown  or  cases  of  deception.  The 
user  must  reason  over  cultural  knowledge  to  determine  if 
the  machine  instances  are  correct. 

The  distinction  between  the  actor  and  the  subject  being 
observed  creates  a  scenario  of  bilateral  cultural 
assessment.  Figure  5  shows  the  case  where  the  actor 
observes  the  subject  for  normal  detection.  If  there  is  no 
action  (open)  then  the  user  expects  no  information.  Two 
cultural  cases  have  to  be  explored  (a)  subject  is  there  but 
evades  or  conceals  detection  and  (b)  the  subject  creates 
deception  that  causes  the  actor  to  question  the  results  (e.g. 
false  alarm  of  detections  of  others,  instrumentation  attack 
by  spoofing,  or  anomalies  in  cultural  norms). 


[  Hold'wait  ] 


Figure  4.  Actor-Subject  Relations  in  PSYOPS. 

6.1  Cultural  Scenario 

To  simulate  the  ideas  in  an  example,  we  utilize  the  OODA- 
TECK  model  for  Bayesian  analysis.  Since  the  process  is 
cyclic,  a  priori  information  has  been  collected  over  time. 
For  the  simulation,  the  processing  begins  with  the  IF 
processing  from  the  machine.  Assuming  that  the  data 
collected  is  equivalent  between  the  distinction  between  the 
person  identity  (1)  and  the  incorrect  person  identity  (0) 
each  is  equivalent  p  =  [0.5  0.5].  After  analysis,  the 
likelihood  of  the  analysis  determines  the  regions  of  the 
correct  analysis  as  well  as  the  regions  of  error.  The  choice 
of  depiction  of  the  results  is  two-fold,  to  show  the  correct 
regions  typical  of  analysis  7(111)  +  7(010)  and  then 
separate  errors  from  deception  7(1 10)  and  concealment 
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P(0I1).  Cultural  differences  are  required  to  solve  the 
problem  for  situational  understanding.  For  concealment, 
the  user  must  query  other  information  sources  to  ascertain 
the  location  and  ID  of  the  subject  (Technology).  For 
deception,  the  user  must  address  the  ideological 
implications  of  the  subject  (Culture).  Together  the  user 
must  address  the  emotional  issues  associated  with  finding, 
requiring,  and  searching  for  the  subject.  From  Figure  5, 
deception  is  P(R 1  ISO)  -  for  receive  1  but  sent  nothing  - 
and  concealment  is: 

PfSllRm _ moisimsi) _ 

i  iku;  -  p(RQ  |  S1)  p(S1)  +  p(RQ  I  SO)  P(S0) 


6.2  Case  1:  Accumulating  Evidence 

A  cycle  repeats  itself  with  the  evidence  supporting  the 
cultural  analysis  of  a  person’s  actions.  Since  technology  is 
working  properly  (i.e.  detecting  a  subject  in  the  open), 
P(]  II),  the  evidence  supports  the  known  location  of  the 
subject  and  their  actions  -  large  blue  area  in  Figure  6. 


TECK-ODDA  Normal  Processing 

Bayes  Culture  g  (posterior),  r  (likelihood)  Bayes  Emotion  g  (posterior), '  (likelihood) 


Bayes  Knowledge  g(post),  r(like)  Bayes  Culture  c(post),  r(like) 


Figure  5.  Accumulating  Evidence. 


6.3  Case  2:  Deception  (i.e.  PSYOPS) 

In  this  case,  the  actor  being  detected  is  sending  cultural 
deceptive  responses  (magenta  block).  The  user  must 
investigate,  scrutinize,  probe,  inspect  the  deception  and 
act,  refrain,  abstain  from  the  information.  If  no  action  is 
taken,  the  accumulated  evidence  errs  on  the  side  of  the 
subject  location  and  identification  (the  red  area  below  the 
green  likelihood  line  in  Figure  7). 


TECK-ODDA:  Deception 

Bayes  Cutture  g  (posterior),  r  (likelihood)  Rayes  Emotion  g  (posterior),  r  (ikaihonri) 


Bayes  Knowledge  g(post;,r(liko)  BayesCuluie  g(pDst).  r(likc) 


Figure  6.  Deception. 


6.4  Case  3:  Deception  with  Cultural  Assessment 

In  this  case,  the  cultural  information  discounts  the 
deceptive  signals  (magenta  block).  The  user  utilizes  its 
own  organizational  cultural  knowledge,  constrained 
emotions  relative  to  the  risk,  and  the  anomaly  associated 
with  the  behaviors  that  are  culturally  inconsistent.  The 
information  in  this  OODA  cycle  is  discounted,  preserving 
the  knowledge  assessment  for  decision-making  (again  the 
large  blue  area  to  the  right  in  Figure  8). 

TECK-ODDA:  Deception  with  Correction 


Bayes  Culture  g  (posterior),  r  (likelihood)  Bayes  Emotion  g  (posterior),  r  (likelihood) 


Bayes  Knowledge  g(post).  r(like)  Bayes  Culture  g(eost).  rflikel 


Figure  7.  Deception  with  Correction. 


From  the  plots  in  Figures  6-8,  it  is  easy  to  see  the  impact 
of  “culture”  by  the  user’s  recognition  of  deception. 

7  Implications  for  Command/  Control 

The  paper’s  purpose  is  to  demonstrate  the  importance  of 
“cultural  awareness”  in  IF  processing.  Techniques 
associated  with  game  theory,  dynamic  programming,  and 
learning  include  multi-player  games.  These  techniques 
characterize  a  known  set  of  behaviors  (e.g.  winning  a  chess 
game);  however,  real-world  SU  of  targeting  requires 
cultural  acknowledgement  related  to  the  organization 
deploying  the  sensors,  the  user  exploiting  the  data,  and  the 
target’s  varying  cultural  features.  Together,  emotions  and 
deception  can  lead  to  erroneous  (false  alarms)  from  which 
traditional  methods  require  user  involvement. 
Implementation  of  this  method  requires  (1)  fusion 
reasoning  over  data,  (2)  user  control  to  adapt  to  changing 
conditions,  and  (3)  enhanced  processing  for  timeliness. 

Situational  understanding  requires  more  than  data 
overlay,  historical  data  regression,  and  context.  Utilizing 
techniques  of  IF  in  SA  can  reduce  false  alarms,  maintain 
track  histories,  and  incorporate  context  such  as  terrain 
information.  Nyquist  sampling  based  on  the  behavioral 
operating  conditions  of  variations  in  sensors,  objects,  and 
the  environment  is  needed  to  detect  impact  cues  of  the 
emerging  situations. 

Interactive  control  from  the  user  can  include  pointing 
sensors,  extracting  portions  of  the  data  (pulling  out  a 
section  of  the  image  simultaneously  with  other  users),  and 
combing  various  perspectives  for  enhanced  understanding. 
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The  user  would  like  mechanisms  of  IF  to  mine,  filter,  and 
predict  data  for  salient  cueing  of  future  threats. 

Technical  advances  afford  faster  data  delivery,  higher 
throughput,  and  low-cost  solutions  to  complement  cultural 
decision-making.  Cultural  DM  requires:  (1)  SU,  (2) 
dynamic  responsiveness  to  changing  conditions,  and  (3) 
evaluation  to  meet  throughput  and  latency  requirements. 
These  factors  afford  sensor  management  replanning.  [44] 
To  afford  interactions  between  future  IF  designs  and  users' 
information  needs ,  metrics  are  required.  The  metrics 
chosen  include  timeliness,  accuracy,  throughput, 
confidence,  and  cost,  [45],  which  are  culturally  sensitive. 


Table  1:  Metrics  for  various  Disciplines  [45]. 


COMM 

User 

Info  Fusion 

ATR/ID 

TRACK 

Delay 

Reaction  Time 

Timeliness 

Acquisition 
/Run  Time 

Update  Rate 

Probability  of 
Error 

Confidence 

Confidence 

Prob.  (Hit), 
Prob.  (FA) 

Prob.  of 
Detection 

Delay 

Variation 

Attention 

Accuracy 

Positional 

Accuracy 

Covariance 

Throughput 

Workload 

Throughput 

No.  Images 

No.  Targets 

Cost 

Cost 

Cost 

No.  platforms 

No.  Assets 

8  Summary 

The  purpose  of  this  paper  was  to  provide  some  insight  into 
user  cultural  issues  for  user  refinement  and  situational 
understanding.  The  DFIG  requires  user  needs  presentation 
to  support  effective  and  efficient  proactive  decision 
making.  This  paper  discussed  important  cultural  issues  for 
(1)  establishing  a  priori  cultural  data  for  machine 
processing,  (2)  involving  user  refinement  over  abductive 
cultural  reasoning,  and  (3)  addressing  organizational 
planning  over  cultural  analysis  impacts  of  actions. 
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